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(54) Finger sensor operating technique 

(57) The functionality of a touchpad and fingerprint 
sensor into a single sensor. This is achieved by using a 
conventional high resolution finger detecting sensor, 
such as a capacitive sensor, coupled to a processor run- 
ning appropriate software which performs either finger- 
print operations or finger motion detection as a function 
of the application required to be performed at any par- 
ticular time by a user. More specifically, in a first mode 
for performing fingerprint operations, the software inter- 
acts with the capacitive sensor to obtain a fingerprint 
"image", if there is a finger in contact with the sensor, 



and to process the fingerprint images, such as analyzing 
it to detect patterns, storing the fingerprint image, or 
comparing the fingerprint image against other stored fin- 
gerprint images, a second mode, for performing finger 
motion detection, the software obtains successive fin- 
gerprint images and analyzes them to detect direction 
of motion and amount of motion, e.g., by identifying par- 
ticular features of the fingerprint and determining their 
location in each of the successive fingerprint images. 
Advantageously, a savings in both cost and space re- 
quired is achieved with respect to the prior art systems. 
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Description 
Technical Field 

[0001] This invention relates to the art of sensors 
which detect information about fingers. 

Background of the invention 

[0002] In the prior art it is well known that low resolu- 
tion sensors, e.g., capacitive-type sensors, can be used 
as trackpads or touchpads, i.e., sensors that track the 
movement of a finger and convert the motion into infor- 
mation useable by a computer. It is further known that 
high resolution sensors, e.g., capacitive or optical-type 
sensors, can be used to detect the ridges and valleys of 
fingerprints, and which enables information as to the mi- 
nutia, which are the identifying features of the finger- 
prints, to be available in a computer useable format, so 
that identification of the person whose finger is being 
sensed may be achieved. 

Summary of the Invention 

[0003] I have recognized that in the prior art different 
technologies are used for the motion sensing touchpads 
and for the fingerprint information sensing. As a result, 
to perform both functions, in the prior art, two distinct 
sensors, and their respective corresponding systems, 
are necessary. As a result, the performance of both 
functions in the prior art is costly, and it also takes up 
additional space beyond that which is necessary for the 
performance of only one of the functions. The need for 
such extra space is especially disadvantageous in mo- 
bile devices as space in such devices is often at a pre- 
mium. 

[0004] These disadvantages of th e prior art are avoid- 
ed by combining, using a single sensor, the functionality 
of a touchpad and fingerprint sensor. This is achieved 
by using a conventional high resolution sensor, such as 
a capacitive-type sensor, optical-type sensor, or any 
conventional finger detecting sensor, coupled to a proc- 
essor running appropriate software which performs ei- 
ther fingerprint operations or finger motion detection as 
a function of the application required to be performed at 
any particular time by a user. More specifically, in a first 
mode for performing fingerprint operations, the software 
interacts with the high resolution sensor to obtain a fin- 
gerprint "image", e.g., the ridges and valleys of the fin- 
ger, if there is a finger in contact with the sensor, and to 
process the fingerprint images in a manner-consistent 
with fingerprint functionality, such as analyzing it to de- 
tect patterns, storing the fingerprint image, or comparing 
the fingerprint image against other stored fingerprint im- 
ages. In a second mode, for performing finger motion 
detection, the software obtains successive fingerprint 
images and analyzes them to detect direction of motion 
and amount of motion, e.g., by identifying particular fea- 



tures of the fingerprint and determining their location in 
each of the successive fingerprint images. Advanta- 
geously, a savings in both cost and space required to 
perform both motion sensing and fingerprint analysis is 
5 achieved with respect to the prior art systems. 

Brief Description of the Drawing 

[0005] In the drawing: 

10 

FIG. 1 shows an exemplary system arranged in ac- 
cordance with the principles of the invention; 
FIG. 2 shows an exemplary prior art capacitive sen- 
sor for detecting fingerprints; and 
15 FIG. 3 shows an exemplary process for employing 
the system of FIG. 1 to perform both fingerprint op- 
erations or finger motion detection in accordance 
with the principles of the invention. 

20 Detailed Description 

[0006] The following merely illustrates the principles 
of the invention. It will thus be appreciated that those 
skilled in the art will be able to devise various arrange- 
rs ments which, although not explicitly described or shown 
herein, embody the principles of the invention and are 
included within its spirit and scope. Furthermore, all ex- 
amples and conditional language recited herein are 
principally intended expressly to be only for pedagogical 

30 purposes to aid the reader in understanding the princi- 
ples of the invention and the concepts contributed by 
the inventor(s) to furthering the art, and are to be con- 
strued as being without limitation to such specifically re- 
cited examples and conditions. Moreover, all state- 

3$ ments herein reciting principles, aspects, and embodi- 
ments of the invention, as well as specific examples 
thereof, are intended to encompass both structural and 
functional equivalents thereof. Additionally, it is intended 
that such equivalents include both currently known 

40 equivalents as well as equivalents developed in the fu- 
ture, i.e., any elements developed that perform the 
same function, regardless of structure. 
[0007] Thus, for example, it will be appreciated by 
those skilled in the art that the block diagrams herein 

45 represent conceptual views of illustrative circuitry em- 
bodying the principles of the invention. Similarly, it will 
be appreciated that the various flow charts, flow dia- 
grams, state transition diagrams, pseudocode, and the 
like represent various processes which may be substan- 

50 tially represented in computer readable medium and so 
executed by a computer or processor, whether or not 
such computer or processor is explicitly shown. 
[0008] The functions of the various elements shown 
in the FIGs., including functional blocks labeled as 

55 "processors" may be provided through the use of dedi- 
cated hardware as well as hardware capable of execut- 
ing software in association with appropriate software. 
When provided by a processor, the functions may be 
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provided by a single dedicated processor, by a single 
shared processor, or by a plurality of individual proces- 
sors, some of which may be shared. Moreover, explicit 
use of the term "processor" or "controller" should not be 
construed to refer exclusively to hardware capable of 
executing software, and may implicitly include, without 
limitation, digital signal processor (DSP) hardware, 
read-only memory (ROM) for storing software, random 
access memory (RAM), and non-volatile storage. Other 
hardware, conventional and/or custom, may also be in- 
cluded. Similarly, any switches shown in the FIGS, are 
conceptual only. Their function may be carried out 
through the operation of program logic, through dedicat- 
ed logic, through the interaction of program control and 
dedicated logic, or even manually, the particular tech- 
nique being selectable by the implementor as more spe- 
cifically understood from the context. 
[0009] In the claims hereof any element expressed as 
a means for performing a specified function is intended 
to encompass any way of performing that function in- 
cluding, for example, a) a combination of circuit ele- 
ments which performs that function or b) software in any 
form, including, therefore, firmware, microcode or the 
like, combined with appropriate circuitry for executing 
that software to perform the function. The invention as 
defined by such claims resides in the fact that the func- 
tionalities provided by the various recited means are 
combined and brought together in the manner which the 
claims call for. Applicant thus regards any means which 
can provide those functionalities as equivalent as those 
shown herein. 

[0010] FIG. 1 shows an exemplary system arranged 
in accordance with the principles of the invention. 
Shown in FIG. 1 are processor 101, memory 103 and 
sensor 105. 

[0011] Processor 101 executes various software 
modules, which may be stored in memory 103. 
[0012] Memory 103 stores software modules for exe- 
cution by processor 101, as well as other information, 
such as fingerprint images captured by sensor 105 or 
other stored fingerprint images. Additionally, or in the al- 
ternative, memory 103 may store information regarding 
specific features which are identified, or extracted, e.g., 
by processor 101 or another processor (not shown), 
from a fingerprint image. Memory 103 may include both 
long and short term memory, as well as volatile or non- 
volatile memory, and also include a component at a re- 
mote location, e.g., accessible over a communications 
network, in any combination desired by an implementor. 
[001 3] Sensor 1 05 is a high resolution sensor suitable 
for detecting the ridges and valleys of fingerprints to a 
resolution that permits minutia, which are the identifying 
features of the fingerprints, to be determined using con- 
ventional computer fingerprint analysis techniques. 
Thus, sensor 105 may be a capacitive-type sensor, an 
optical type sensor, or any conventional finger detecting 
sensor. 

[0014] For example, FIG. 2 shows an exemplary prior 



art capacitive sensor for detecting fingerprints which 
may be used as sensor 105 (FIG. 1). More specifically 
FIG. 2 shows a topological sensor 201 that contains an 
array of sensing elements 203. The individual sensing 

5 elements 203 typically have dimensions smaller than 
the item under investigation. When used as a fingerprint 
sensor, the sensing elements should have dimensions 
that are smaller than the ridges and valleys of a finger. 
Disposed above the sensing elements is a suitable in- 
to sulating material such as glass or plastic, for example, 
which serves as a sensing surface 205. This sensor is 
more fully described in United States Patent Application 
Serial No. 08/57310, which in incorporated by reference 
as if fully set forth herein. 

is [0015] FIG. 3 shows an exemplary process for em- 
ploying the system of FIG. 1 to perform both fingerprint 
operations and finger motion detection in accordance 
with the principles of the invention. The process shown 
in FIG. 3 is typically performed by an operating system 

20 executing on a processor, e.g., processor 101 (FIG. 1), 
in response to requests from a similarly executing ap- 
plication program or the operating system itself. Thus, 
typically, the particular function to be performed using 
sensor 1 05 will be set by the current application program 

25 and communicated to the operating system. 

[0016] The process is entered in step 301 (FIG. 3) 
when it is determined that either a fingerprint needs to 
be obtained, such as may be required for an identity ver- 
ification for a security application, or when it is neces- 

30 sary to determine if a user's finger has moved on sensor 
105, so that a cursor location, or motion dependent in- 
formation, can be updated. Next, in step 303, a finger- 
print image, i.e., the pattern of ridges and valleys of a 
finger, is acquired by sensor 105. Note that if no finger 

35 is in contact with sensor 105 the image will be blank. 
Thereafter, conditional branch point 305 tests to deter- 
mine if sensor 105 is being used to perform verification 
of the user's identity. 

[0017] If the test result in step 305 is YES, indicating 

^0 that sensor 105 is being used to perform verification of 
the user's identity, control passes to step 307, in which 
the acquired fingerprint image is compared against a da- 
tabase of fingerprint information. This comparison may 
be achieved a) by directly comparing the acquired fin- 

^5 gerprint image against stored fingerprint images in the 
database; b) by comparing information derived from the 
acquired fingerprint image such as, minutia, which in- 
cludes whorls, loops, bifurcations and the like, against 
information stored in the database that was derived from 

so other finger prints; or c) any combination thereof. In step 
309, the results of the comparison are set for return to 
the program which called the process of FIG. 3. For ex- 
ample, if a match is found, an indication may be returned 
indicating either only that a match was found or an indi- 

ss cation may be returned which sets forth the particular 
party with which the match was found. On the other 
hand, if a match is not found, a null result may be re- 
turned. The process then exits in step 315. 
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[0018] If the test result in step 305 is NO, indicating 
that sensor 105 is being used to detect finger motion 
over its surface, control passes to step 311 , in which the 
fingerprint image just acquired in step 303 is compared 
with information from at least one previously acquired 
fingerprint images. This comparison may be achieved 
a) by directly comparing the acquired fingerprint image 
against the previously acquired fingerprint image; b) by 
comparing information derived from the acquired finger- 
print image such as, the edges of the finger or minutia, 
which includes whorls, loops, bifurcations and the like, 
against similar information that was derived from the 
previously acquired fingerprint image; or c) any combi- 
nation thereof. Any conventional form of image process- 
ing may be used for performing the comparison. In step 
313, a motion vector is formed as a result of the com- 
parison and is returned in step 311. The motion vector 
indicates the relative motion with respect to the last de- 
tected position of the finger Note that relative motion 
may encompass both direction of motion and amount of 
motion. The process then exits in step 315. 
[0019] When finger motion is being detected by sen- 
sor 105, it is possible to detect a tapping by the user on 
sensor 105 This is achieved by detecting first the pres- 
ence of a finger on sensor 105, then its absence, and 
then its presence again, all within prescribed times, as 
will be appreciated by those of ordinary skill in the art. 
Similarly, with regard to detecting finger motion, if the 
finger is removed from sensor 105, the location against 
which relative motion may be determined is reset once 
the finger again touches sensor 105. 
[0020] Note that the process in FIG. 3 may be called 
repeatedly to smoothly detect finger motion over the sur- 
face of sensor 105, e.g. for use in controlling a cursor 
or a drawing tool. Similarly, the process in FIG. 3 may 
be called whenever an verification of the identity of the 
user is required, e.g., when logging on to a computer 
system, computer network, or when making financial 
transactions. 

[0021] Instead of incorporating the software within the 
operating system, such software may be incorporated 
within particular application programs. Additionally, the 
comparison software, such as is called for in step 307, 
may be performed by an external processor, e.g., using 
a connection over a computer network. 
[0022] For detecting motion, a finger may not itself ac- 
tually be required. Instead, another sensable surface, 
may be moved over the surface of sensor 105. Such a 
surface may be arranged to have constrained motion 
over the surface of sensor 105. 



Claims 

1 . A method for use with a processor coupled to a sen- 
sor capable of acquiring a fingerprint image com- 
prising the steps of: 



acquiring a first fingerprint image; 
in a first mode of operation of said processor, 
comparing said acquired fingerprint image 
against other stored fingerprint information; 

5 and 

in a second mode of operation of said proces- 
sor, acquiring a second fingerprint image and 
determining motion of a finger whose image is 
acquired as said first and second fingerprint im- 

10 ages. 

2. Apparatus, comprising: 

a sensor for detecting ridges and valleys of a 

75 fingerprint; 

a processor, coupled to said sensor, for com- 
paring a fingerprint detected by said sensor 
with a prestored fingerprint to determine either 
. a similarity of said detected fingerprint to said 

20 prestored fingerprint or a motion of said detect- 

ed fingerprint with respect to said prestored fin- 
gerprint. 

3. A method for use with a portable device including a 
25 sensor for detecting ridges and valleys of a finger- 
print and a processor, comprising: 

obtaining a fingerprint image by said sensor; 
comparing said obtained fingerprint image with 

30 a prestored fingerprint image; 

wherein, in a first mode, said comparing step 
functions to determine a similarity of said ob- 
tained fingerprint to a prestored fingerprint and 
in a second mode said comparing step func- 

35 tions to determine a motion of said obtained fin- 

gerprint with respect to said prestored finger- 
print. 

4. The method as defined in claim 1 or 3, wherein said 
40 comparing step is performed by comparing feature 

information extracted from said acquired fingerprint 
image against feature information of said stored fin- 
gerprint information. 

45 5. The method as defined in claim 1 or 3 wherein said 
comparing step is performed using image process- 
ing. 

6. The method as defined in claim 1 or 3, or the appa- 
50 ratus of claim 2 wherein said sensor capable of ac- 
quiring a fingerprint image is either a capacitive sen- 
sor, or an optical sensor, or a high resolution sensor. 

7. The method as defined in claim 1 or 3, further in- 
55 eluding the step of: 

in a third mode of operation, either storing said 
acquired fingerprint image for substantially 
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long term use, or storing said acquired finger- 
print image in a substantially non-volatile stor- 
age for. long term use as part of said other 
stored fingerprint information, or extracting fea- 
ture information from said acquired fingerprint 
image for substantially long term use; and 
storing said extracted feature information for 
substantially long term use, or extracting fea- 
ture information from said acquired fingerprint 
image for substantially long term use; and 
storing said extracted feature information for 
substantially long term use in a substantially 
non-volatile storage. 

8. Apparatus, comprising: 

means for detecting ridges and valleys of a fin- 
gerprint; 

means, coupled to said sensor, for comparing 
a fingerprint detected by said sensor with a 
prestored fingerprint to determine either a sim- 
ilarity of said detected fingerprint to said 
prestored fingerprint or a motion of said detect- 
ed fingerprint with respect to said prestored fin- 
gerprint. 

9. The apparatus as defined in claim 8 or the method 
of claim 3, wherein said prestored fingerprint is 
stored in either long-term memory, or in short-term 
memory. 

10. The method as defined in claim 3, wherein in said 
first mode said prestored fingerprint is stored in 
long-term memory and in said second mode said 
prestored fingerprint is stored in short-term memo- 
ry. 

11. The method as defined in claim 10, wherein said 
comparing step is performed using information de- 
rived from said obtained fingerprint image and said 
prestored fingerprint image. 

12. The A method for use with a processor coupled to 
a sensor capable of acquiring a fingerprint image 
comprising the steps of: 

acquiring information relating to a first finger- 
print image; 

in a first mode of operation of said processor, 
comparing said acquired fingerprint information 
against other stored fingerprint information; 
and 

in a second mode of operation of said proces- 
sor, acquiring information relating to a second 
fingerprint image and determining motion of a 
finger whose image is acquired as said first and 
second fingerprint images. 



1 3. A method for use with a portable device including a 
sensor for detecting ridges and valleys of a finger- 
print and a processor, comprising: 

obtaining information relating to a fingerprint 
image using said sensor; 
comparing said obtained fingerprint information 
with a prestored fingerprint information; 
wherein, in a first mode, said comparing step 
functions to determine a similarity of said ob- 
tained fingerprint information to prestored fin- 
gerprint information and in a second mode said 
comparing step functions to determine a motion 
of a finger generating said obtained fingerprint 
information with respect to said prestored fin- 
gerprint information. 
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